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Abstract. The continuous and discrete symmetries of the Kuramoto-Sivashinsky system re- 
stricted to a spatially periodic domain play a prominent role in shaping the invariant sets of its 
chaotic dynamics. The continuous spatial translation symmetry leads to relative equilibrium (travel- 
ing wave) and relative periodic orbit (modulated traveling wave) solutions. The discrete symmetries 
lead to existence of equilibrium and periodic orbit solutions, induce decomposition of state space 
into invariant subspaces, and enforce certain structurally stable heteroclinic connections between 
equilibria. We show, on the example of a particular small-cell Kuramoto-Sivashinsky system, how 
the geometry of its dynamical state space is organized by a rigid 'cage' built by heteroclinic connec- 
tions between equilibria, and demonstrate the preponderance of unstable relative periodic orbits and 
their likely role as the skeleton underpinning spatiotemporal turbulence in systems with continuous 
symmetries. We also offer novel visualizations of the high-dimensional Kuramoto-Sivashinsky state 
space flow through projections onto low-dimensional, PDE representation independent, dynamically 
invariant intrinsic coordinate frames, as well as in terms of the physical, symmetry invariant energy 
transfer rates. 
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1. Introduction. Recent experimental and theoretical advances [24] support a 
dynamical vision of turbulence: For any finite spatial resolution, a turbulent flow 
follows approximately for a finite time a pattern belonging to a finite alphabet of 
admissible patterns. The long term dynamics is a walk through the space of these 
unstable patterns. The question is how to characterize and classify such patterns? 
Here we follow the seminal Hopf paper [26] , and visualize turbulence not as a sequence 
of spatial snapshots in turbulent evolution, but as a trajectory in an infinite-dimens- 
ional state space in which an instant in turbulent evolution is a unique point. In 
the dynamical systems approach, theory of turbulence for a given system, with given 
boundary conditions, is given by (a) the geometry of the state space and (b) the 
associated natural measure, that is, the likelihood that asymptotic dynamics visits a 
given state space region. 

We pursue this program in context of the Kuramoto-Sivashinsky (KS) equa- 
tion, one of the simplest physically interesting spatially extended nonlinear systems. 
Holmes, Lumley and Berkooz [ ] offer a delightful discussion of why this system de- 
serves study as a staging ground for studying turbulence in full-fledged Navier- Stokes 
boundary shear flows. 

Flows described by partial differential equations (PDEs) are said to be infinite- 
dimensional because if one writes them down as a set of ordinary differential equations 
(ODEs), a set of infinitely many ODEs is needed to represent the dynamics of one 
PDE. Even though their state space is thus infinite-dimensional, the long-time dy- 
namics of viscous flows, such as Navier- Stokes, and PDEs modeling them, such as 
Kuramoto-Sivashinsky, exhibits, when dissipation is high and the system spatial ex- 
tent small, apparent 'low-dimensional' dynamical behaviors. For some of these the 
asymptotic dynamics is known to be confined to a finite-dimensional inertial mani- 
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fold^ though the rigorous upper bounds on this dimension are not of much use in the 
practice. 

For large spatial extent the complexity of the spatial motions also needs to be 
taken into account. The systems whose spatial correlations decay sufficiently fast, and 
the attractor dimension and number of positive Lyapunov exponents diverges with 
system size are said [27, 41, 9] to be extensive, 'spatio-temporally chaotic' or 'weakly 
turbulent.' Conversely, for small system sizes the accurate description might require 
a large set [ ] of coupled ODEs, but dynamics can still be 'low-dimensional' in the 
sense that it is characterized with one or a few positive Lyapunov exponents. There 
is no wide range of scales involved, nor decay of spatial correlations, and the system 
is in this sense only 'chaotic' 

For a subset of physicists and mathematicians who study idealized 'fully devel- 
oped,' 'homogenous' turbulence the generally accepted usage is that the 'turbulent' 
fluid is characterized by a range of scales and an energy cascade describable by statisti- 
cal assumptions [15]. What experimentalists, engineers, geophysicists, astrophysicists 
actually observe looks nothing like a 'fully developed turbulence.' In the physically 
driven wall-bounded shear flows, the turbulence is dominated by unstable coherent 
structures, that is, localized recurrent vortices, rolls, streaks and like. The statistical 
assumptions fail, and a dynamical systems description from first principles is called 
for [ i]. 

The set of invariant solutions investigated here is embedded into a finite- dimens- 
ional inertial manifold [ ] in a non-trivial, nonlinear way. 'Geometry' in the title 
of this paper refers to our attempt to systematically triangulate this set in terms of 
dynamically invariant solutions (equilibria, periodic orbits, . . .) and their unstable 
manifolds, in a PDF representation and numerical simulation algorithm independent 
way. The goal is to describe a given 'turbulent' flow quantitatively, not model it 
qualitatively by a low-dimensional model. For the case investigated here, the state 
space representation dimension d ^ 10^ is set by requiring that the exact invariant 
solutions that we compute are accurate to ~ 10~^. 

Here comes our quandary. If we ban the words 'turbulence' and 'spatiotemporal 
chaos' from our study of small extent systems, the relevance of what we do to larger 
systems is obscured. The exact unstable coherent structures we determine pertain not 
only to the spatially small 'chaotic' systems, but also the spatially large 'spatiotempo- 
rally chaotic' and the spatially very large 'turbulent' systems. So, for the lack of more 
precise nomenclature, we take the liberty of using the terms 'chaos,' 'spatiotemporal 
chaos,' and 'turbulence' interchangeably. 

In previous work, the state space geometry and the natural measure for this 
system have been studied [6, 37, 38] in terms of unstable periodic solutions restricted 
to the antisymmetric subspace of the KS dynamics. 

The focus in this paper is on the role continuous symmetries play in spatiotem- 
poral dynamics. The notion of exact periodicity in time is replaced by the notion 
of relative spatiotemporal periodicity, and relative equilibria and relative periodic or- 
bits here play the role the equilibria and periodic orbits played in the earlier studies. 
Our search for relative periodic orbits in KS system was inspired by Vanessa Lopez 
et al. [40] investigation of relative periodic orbits of the Complex Ginzburg-Landau 
equation. However, there is a vast literature on relative periodic orbits since their 
first appearance, in Poincare study of the 3-body problem [5, 47], where the Lagrange 
points are the relative equilibria. They arise in dynamics of systems with contin- 
uous symmetries, such as motions of rigid bodies, gravitational TV-body problems. 
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molecules and nonlinear waves. Recently Viswanath [ ] has found both relative 
equilibria and relative periodic orbits in the plane Couette problem. A Hopf bifurca- 
tion of a traveling wave [i, 34] induces a small time-dependent modulation. Brown 
and Kevrekidis [ 4] study bifurcation branches of periodic orbits and relative periodic 
orbits in KS system in great detail. For our system size {a = 49.04 in their notation) 
they identify a periodic orbit branch. In this context relative periodic orbits are re- 
ferred to as 'modulated traveling waves.' For fully chaotic flows we find this notion 
too narrow. We compute 60,000 periodic orbits and relative periodic orbits that are 
in no sense small 'modulations' of other solutions, hence our preference for the well 
established notion of a 'relative periodic orbit.' 

Building upon the pioneering work of refs. [32, 22, 4], we undertake here a study 
of the Kuramoto-Sivashinsky dynamics for a specific system size L = 22, sufficiently 
large to exhibit many of the features typical of 'turbulent' dynamics observed in 
large KS systems, but small enough to lend itself to a detailed exploration of the 
equilibria and relative equilibria, their stable/unstable manifolds, determination of a 
large number of relative periodic orbits, and a preliminary exploration of the relation 
between the observed spatiotemporal 'turbulent' patterns and the relative periodic 
orbits. 

In presence of a continuous symmetry any solution belongs to a group orbit of 
equivalent solutions. The problem: If one is to generalize the periodic orbit theory 
to this setting, one needs to understand what is meant by solutions being nearby 
(shadowing) when each solution belongs to a manifold of equivalent solutions. In a 
forthcoming publication [ ] we resolve this puzzle by implementing symmetry reduc- 
tion. Here we demonstrate that, for relative periodic orbits visiting the neighborhood 
of equilibria, if one picks any particular solution, the universe of all other solutions 
is rigidly fixed through a web of heteroclinic connections between them. This insight 
garnered from study of a 1-dimensional Kuramoto-Sivashinsky PDF is more remark- 
able still when applied to the plane Couette fiow [19], with 3-d velocity fields and two 
translational symmetries. 

The main results presented here are: (a) Dynamics visualized through physical, 
symmetry invariant observables, such as 'energy,' dissipation rate, etc., and through 
projections onto dynamically invariant, PDF-discretization independent state space 
coordinate frames, sect. 3. (b) Fxistence of a rigid 'cage' built by heteroclinic con- 
nections between equilibria, sect. 4. (c) Preponderance of unstable relative periodic 
orbits and their likely role as the skeleton underpinning spatiotemporal turbulence in 
systems with continuous symmetries, sect. 6. 

2. Kuramoto-Sivashinsky equation. The Kuramoto-Sivashinsky [henceforth 
KS] system [36, 46], which arises in the description of stability of fiame fronts, reaction- 
diffusion systems and many other physical settings [32] , is one of the simplest nonlinear 
PDFs that exhibit spatiotemporally chaotic behavior. In the formulation adopted 
here, the time evolution of the 'ffame front velocity' u = u{x^ t) on a periodic domain 
u{x^ t) = u{x + L, t) is given by 

ut = F{u) = -\{u^)x - - Uxxxx , X e [-L/2, L/2] . (2.1) 

Here t > is the time, and x is the spatial coordinate. The subscripts x and t denote 
partial derivatives with respect to x and t. In what follows we shall state results of 
all calculations either in units of the 'dimensionless system size' L, or the system size 
L = 27tL. Figure 2.1 presents a typical 'turbulent' evolution for KS. All numerical 
results presented in this paper are for the system size L = 22/27r = 3.5014. . ., for 
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which a structurahy stable chaotic attractor is observed (see Figure 4.1). Spatial 
periodicity u{x^t) = u{x + makes it convenient to work in the Fourier space, 

+00 

u{x,t)= J2 ak{t)e"'^/^, (2.2) 

k= — oo 

with the 1-dimensional PDF (2.1) replaced by an infinite set of ODFs for the complex 
Fourier coefficients ak{t): 

+00 

dk = Vk{a) = {ql - ql) at - ^ cimCik-m , (2.3) 

m= — oo 

where qk = k/L. Since u{x^t) is real, ak = al^, and we can replace the sum by an 
m > sum. 

Due to the hyperviscous damping Uxxxx-, long time solutions of KS equation are 
smooth, ak drop off fast with /c, and truncations of (2.3) to 16 < < 128 terms yield 
accurate solutions for system sizes considered here (see appendix A). Robustness of 
the long-time dynamics of KS as a function of the number of Fourier modes kept in 
truncations of (2.3) is, however, a subtle issue. Adding an extra mode to a truncation 
of the system introduces a small perturbation in the space of dynamical systems. 
However, due to the lack of structural stability both as a function of truncation 
A/", and the system size L, a small variation in a system parameter can (and often 
will) throw the dynamics into a different asymptotic state. For example, asymptotic 
attractor which appears to be chaotic in a A/'-dimensional state space truncation can 
collapse into an attractive cycle for (A/" + 1) -dimensions. Therefore, the selection of 
parameter L for which a structurally stable chaotic dynamics exists and can be studied 
is rather subtle. We have found that the value of L = 22 studied in sect. 4 satisfies 
these requirements. In particular, all of the equilibria and relative equilibria persist 
and remain unstable when A^ is increased from 32 (the value we use in our numerical 
investigations) to 64 and 128. Nearly all of the relative periodic orbits we have found 
for this system also exist and remain unstable for larger values of N as well as smaller 
values of the integration step size (see appendix C for details). 

2.1. Symmetries of Kuramoto-Sivashinsky equation. The KS equation is 
Galilean invariant: if u{x^ t) is a solution, then u{x — ct,t) — with c an arbitrary 
constant speed, is also a solution. Without loss of generality, in our calculations we 
shall set the mean velocity of the front to zero. 

As a'o = in (2.3), ao is a conserved quantity fixed to ao = by the condition 
(2.4). G, the group of actions ^ G G on a state space (reflections, translations, 
etc.) is a symmetry of the KS flow (2.1) if gut = F{gu). The KS equation is 
time translationally invariant, and space translationally invariant on a periodic do- 
main under the 1-parameter group of 0(2) : {t£/l^R}. If u{x^t) is a solution, then 
TiiLu{x^t) = u{x ^ t) is an equivalent solution for any shift —L/2 < i < L/2, as is 
the reflection ('parity' or 'inversion') 



Ru{x) = —u{—x) . 



(2.5) 
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Fig. 2.1. A typical spatiotemporally chaotic solution of the Kuramoto-Sivashinsky equation^ 
system size L = 207r\/2 ^ 88.86. The x coordinate is scaled with the most unstable wavelength 27t\/2, 
which is approximately also the mean wavelength of the turbulent flow. The color bar indicates the 
color scheme for u(x, t), used also for the subsequent figures of this type. 

The translation operator action on the Fourier coefficients (2.2), represented here by 
a complex valued vector a = {ak G C | A: = 1, 2, . . .}, is given by 

ri/La = g{i)a, (2.6) 

where g{i) = diag(e*^^^) is a complex valued diagonal matrix, which amounts to 
the k-th mode complex plane rotation by an angle k£/L. The reflection acts on the 
Fourier coefficients by complex conjugation, 

Ra = -a\ (2.7) 

Reflection generates the dihedral subgroup Di = {l,i^} of 0(2). Let U be the 
space of real-valued velocity fields periodic and square integrable on the interval 
n = [-L/2,L/2], 

V = {ue L^(Sl) I u{x) = u{x + L)} . (2.8) 

A continuous symmetry maps each state G U to a manifold of functions with 
identical dynamic behavior. Relation = 1 induces linear decomposition u{x) = 
u^{x) + u~{x)^ u^{x) = P^u{x) G U^, into irreducible subspaces U = U+ U~, 
where 

P+ = (1 + R)/2 , P" = (1 - R)/2 , (2.9) 

are the antisymmetric/symmetric projection operators. Applying P+, P~ on the KS 
equation (2.1) we have [32] 

= -(^^< + U'^x) - ^tx - ^txxx 

Ut = -{u^u- + u-u^) - u-^ - u-^^^ . (2.10) 
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If u =0, KS flow is confined to the antisymmetric U+ subspace, 

uf = —u~^u^ — U^^ — U^xxx 5 (2.11) 

but otherwise the nonlinear terms in (2.10) mix the two subspaces. 

Any rational shift Tii^u{x) = u{x -\- L/m) generates a discrete cyclic subgroup 
Cm of 0(2), also a symmetry of KS system. Reflection together with Cm generates 
another symmetry of KS system, the dihedral subgroup Dm of 0(2). The only non- 
zero Fourier components of a solution invariant under Cm are ajm 7^0, j = l,2,---, 
while for a solution invariant under Dm we also have the condition Keaj = for all 
j. Dm reduces the dimensionality of state space and aids computation of equilibria 
and periodic orbits within it. For example, the 1/2-cell translations 

n/2 = u{x + L/2) (2.12) 

and reflections generate 0(2) subgroup D2 = {1, i?, r, ri?}, which reduces the state 
space into four irreducible subspaces (for brevity, here r = ri/2)' 
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P^^^ is the projection operator onto u^^"^ irreducible subspace, and the last 3 columns 
refer to the symmetry (or antisymmetry) of u'^^^ functions under reflection and 1/2- 
cell shift. By the same argument that identified (2.11) as the invariant subspace of 
KS, here the KS flow stays within the U*^ = U^^^ +U^^^ irreducible Di subspace of u 
profiles symmetric under 1/2-cell shifts. 

While in general the bilinear term {u'^)x mixes the irreducible subspaces of Dn, 
for D2 there are four subspaces invariant under the flow [32]: 
{0}: the u{x) = equilibrium 

U+ = U^^^ + U^^^: the reflection Di irreducible space of antisymmetric u{x) 
IjS = u(i) ^ui'^): the shift Di irreducible space of L/2 shift symmetric u{x) 
U^^^: the D2 irreducible space of u{x) invariant under x L/2 — x^ u —u. 
With the continuous translational symmetry eliminated within each subspace, there 
are no relative equilibria and relative periodic orbits, and one can focus on the equi- 
libria and periodic orbits only, as was done for U+ in refs. [6, 37, 38]. In the Fourier 
representation, the u G U+ antisymmetry amounts to having purely imaginary coeffi- 
cients, since a-k = ctl ~ ~^k' The 1/2 cell-size shift ri/2 generated 2-element discrete 
subgroup {l,Ti/2} is of particular interest because in the U+ subspace the transla- 
tional invariance of the full system reduces to invariance under discrete translation 
(2.12) by half a spatial period L/2. 

Each of the above dynamically invariant subspaces is unstable under small per- 
turbations, and generic solutions of Kuramoto-Sivashinsky equation belong to the full 
space. Nevertheless, since all equilibria of the KS flow studied in this paper lie in 
the U+ subspace (see sect. 4), U+ plays important role for the global geometry of the 
flow. The linear stability matrices of these equilibria have eigenvectors both in and 
outside of U+, and need to be computed in the full state space. 
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2.2. Equilibria and relative equilibria. Equilibria (or the steady solutions) 
are the fixed profile time-invariant solutions, 

u{x,t) = Uq{x) . (2.14) 

Due to the translational symmetry, the KS system also allows for relative equilibria 
(traveling waves, rotating waves), characterized by a fixed profile Uq{x) moving with 
constant speed c, that is 

u{x^ t) = Uq{x — ct) . (2.15) 

Here suffix q labels a particular invariant solution. Because of the reflection symmetry 
(2.5), the relative equilibria come in counter-traveling pairs Uq{x — ct)^ —Uq{—x + ct). 

The relative equilibrium condition for the Kuramoto-Sivashinsky PDE (2.1) is the 
ODE 

H~ '^xx H~ '^xxxx — (2.16) 

which can be analyzed as a dynamical system in its own right. Integrating once we 
get 

^u^ - cu^Ux^ Uxxx = E . (2.17) 

This equation can be interpreted as a 3-dimensional dynamical system with spatial co- 
ordinate X playing the role of 'time,' and the integration constant E can be interpreted 
as 'energy,' see sect. 3. 

For £^ > there is rich £^-dependent dynamics, with fractal sets of bounded 
solutions investigated in depth by Michelson [42]. For L < 1 the only equilibrium of 
the system is the globally attracting constant solution u{x^t) = 0, denoted Eq from 
now on. With increasing system size L the system undergoes a series of bifurcations. 
The resulting equilibria and relative equilibria are described in the classical papers 
of Kevrekidis, Nicolaenko and Scovel [32], and Greene and Kim [2 ], among others. 
The relevant bifurcations up to the system size investigated here are summarized in 
Figure 2.2: at L = 22/27r = 3.5014 ••• , the equilibria are the constant solution Eq, the 
equilibrium Ei called GLMRT by Greene and Kim [39, 22], the 2- and 3-cell states 
E2 and E3, and the pairs of relative equilibria TW±i, TW±2- All equilibria are in the 
antisymmetric subspace U+, while E2 is also invariant under D2 and E3 under Ds. 

In the Fourier representation the relative equilibria time dependence is 

ak{t)e-'''^' =afc(0). (2.18) 

Differentiating with respect to time, we obtain the Fourier space version of the relative 
equilibrium condition (2.16), 

Vk{a) - iqkcak = 0, (2.19) 

which we solve for (time independent) ak and c. Periods of spatially periodic equilib- 
ria are L/n with integer n. Every time the system size crosses L = n-cell states are 
generated through pitchfork bifurcations oS u = equilibrium. Due to the transla- 
tional invariance of Kuramoto-Sivashinsky equation, they form invariant circles in the 
full state space. In the U+ subspace considered here, they correspond to 2n points, 
each shifted by L/2n. For a sufficiently small L the number of equilibria is small and 
concentrated on the low wave-number end of the Fourier spectrum. 
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Fig. 2.2. The energy (3.6) of the equilibria and relative equilibria that exist up to L = 22, 
L = 3.5014 . . plotted as a function of the system size L = L/27T (additional equilibria, not present 
at L = 22 are given in ref. [22]). Solid curves denote n-cell solutions E2 and E3, dotted curves the 
GLMRT equilibrium Ei, and dashed curves the relative equilibria TW±i and TW±2- The parameter 
OL of refs. [32, 22] is related to the system size by L = -^/a/A. 



In a periodic box of size L both equilibria and relative equilibria are periodic 
solutions embedded in 3-d space, conveniently represented as loops in {u^Ux^Uxx) 
space, see Figure b.l{d). In this representation the continuous translation symmetry 
is automatic - a rotation in the [0, L] periodic domain only moves the points along 
the loop. For an equilibrium the points are stationary in time; for relative equilibrium 
they move in time, but in either case, the loop remains invariant. So we do not have 
the problem that we encounter in the Fourier representation, where seen from the 
frame of one of the equilibria the rest trace out circles under the action of continuous 
symmetry translations. 

From (2.3) we see that the origin u{x^t) = has Fourier modes as the linear 
stability eigenvectors (see appendix B). The \k\ < L long wavelength perturbations of 
the flat-front equilibrium are linearly unstable, while for \k\ sufficiently larger than L 
the short wavelength perturbations are strongly contractive. The high k eigenvalues, 
corresponding to rapid variations of the flame front, decay so fast that the correspond- 
ing eigendirections are physically irrelevant. Indeed, ref. [49] shows that the chaotic 
solutions of spatially extended dissipative systems evolve within an inertial manifold 
spanned by a finite number of physical modes, hyperbolically isolated from a set of 
residual degrees of freedom with high /c, themselves individually isolated from each 
other. The most unstable mode, nearest to \k\ = Z/\/2, sets the scale of the mean 
wavelength a/2 of the KS 'turbulent' dynamics, see Figure 2.1. 

2.3. Relative periodic orbits, symmetries and periodic orbits. The KS 

equation (2.1) is time translationally invariant, and space translationally invariant 
under the 1-d Lie group of 0(2) rotations: if u{x^t) is a solution, then u{x-\-£,t) and 
—u{—x^t) are equivalent solutions for any —L/2 < £ < L/2. As a result of invariance 
under t^/l, KS equation can have relative periodic orbit solutions with a profile Up{x)^ 
period Tp, and a nonzero shift £p 

n^/Lu{x, Tp) = u{x + £p, Tp) = u{x, 0) = Up{x) . (2.20) 
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Relative periodic orbits (2.20) are periodic in Cp = ip/Tp co-rotating frame (see Fig- 
ure 8.3), but in the stationary frame their trajectories are quasiperiodic. Due to the 
reflection symmetry (2.5) of KS equation, every relative periodic orbit Up{x) with shift 
ip has a symmetric partner —Up{—x) with shift —ip. 

Due to invariance under reflections, KS equation can also have relative periodic 
orbits with reflection^ which are characterized by a profile Up{x) and period Tp 

Ru{x + Tp) = -u{-x - Tp) = u{x + ^, 0) = Up{x) , (2.21) 

giving the family of equivalent solutions parameterized by i (as the choice of the 
reflection point is arbitrary, the shift can take any value in —L/2 < i < L/2). 

Armbruster et al [2, ] and Brown and Kevrekidis [ ] (see also ref. [ ]) link 
the birth of relative periodic orbits to an infinite period global bifurcation involving 
a heteroclinic loop connecting equilibria or a bifurcation of relative equilibria, and 
also report creation of relative periodic orbit branches through bifurcation of periodic 
orbits. 

As £ is continuous in the interval [—L/2, the likelihood of a relative periodic 
orbit with £p = shift is zero, unless an exact periodicity is enforced by a discrete 
symmetry, such as the dihedral symmetries discussed above. If the shift ip of a relative 
periodic orbit with period Tp is such that ip/L is a rational number, then the orbit 
is periodic with period nTp. The likelihood to find such periodic orbits is also zero. 

However, due to the KS equation invariance under the dihedral Dn and cyclic Cn 
subgroups, the following types of periodic orbits are possible: 

(a) The periodic orbit lies within a subspace pointwise invariant under the action 
of Dn or Cn- For instance, for Di this is the U+ antisymmetric subspace, —Up{—x) = 
Up{x), and u{x,Tp) = u{x,0) = Up{x). The periodic orbits found in refs. [6, 38] 
are all in U^, as the dynamics is restricted to antisymmetric subspace. For L = 22 
the dynamics in U+ is dominated by attracting (within the subspace) heteroclinic 
connections and thus we have no periodic orbits of this type, or in any other of the 
Dn-invariant subspaces, see sect. 4. 

(b) The periodic orbit satisfies 

u{x, t^Tp) = -fu{x, t) , (2.22) 

for some group element 7 G 0(2) such that 7^ = e for some integer m so that the 
orbit repeats after time mTp (see ref. [ ] for a general discussion of conditions on the 
symmetry of a periodic orbit). If an orbit is of reflection type (2.21), Rt£/lu{x, Tp) = 
—u{—x — i^Tp) = 'u(x,0), then it is pre-periodic to a periodic orbit with period 2Tp. 
Indeed, since (^^t^/l)^ = i?^ = 1, and the KS solutions are time translation invariant, 
it follows from (2.21) that 

u{x,2Tp)=RniLu{x,Tp) = {Rt£/l)^u{x,0)=u{x,0) . 

Thus any shift acquired during time to Tp is compensated by the opposite shift 
during evolution from Tp to 2Tp. All periodic orbits we have found for L = 22 are 
of type (2.22) with j = R. Pre-periodic orbits with j G Cn have been found by 
Brown and Kevrekidis [ ] for KS system sizes larger than ours, but we have not found 
any for L = 22. Pre-periodic orbits are a hallmark of any dynamical system with a 
discrete symmetry, where they have a natural interpretation as periodic orbits in the 
fundamental domain [12, 11]. 
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3. Energy transfer rates. In physical settings where the observation times are 
much longer than the dynamical 'turnover' and Lyapunov times (statistical mechan- 
ics, quantum physics, turbulence) periodic orbit theory [ ] provides highly accurate 
predictions of measurable long-time averages such as the dissipation and the turbu- 
lent drag [19]. Physical predictions have to be independent of a particular choice of 
ODE representation of the PDE under consideration and, most importantly, invariant 
under all symmetries of the dynamics. In this section we discuss a set of such physical 
observables for the 1-d KS invariant under reflections and translations. They offer a 
representation of dynamics in which the symmetries are explicitly quotiented out. We 
shall use these observables in sect. 8 in order to visualize a set of solutions on these 
coordinates. 

The space average of a function a = a{x^t) = a{u{x^t)) on the interval L, 

(a) = —j) dx a{x^t) , (3.1) 
is in general time dependent. Its mean value is given by the time average 

a= lim - 1 dr (a) = lim - / ^ (p dr dx a{x^T) . (3.2) 

t^OO t Jq t^OO t Jq LJ 

The mean value of a = a{uq) = aq evaluated on equilibrium or relative equilibrium 
u{x^t) = Uq{x — ct), labeled by q as in (2.15), is 

aq = (a)^ = aq . (3.3) 

Evaluation of the infinite time average (3.2) on a function of a periodic orbit or relative 
periodic orbit Up{x^t) = Up{x -\- ip^t -\- Tp) requires only a single Tp traversal, 

^P = ^ [ "^dr {a) . (3.4) 
-i-P Jo 

Equation (2.1) can be written as 

Ut = -Vx, l/(x,t) = ^ii^ (3.5) 

If u is 'flame- front velocity' then defined in (2.17), can be interpreted as the mean 
energy density. So, even though KS is a phenomenological small-amplitude equation, 
the time-dependent norm of 

E = dx V{x, t) = dx y , (3.6) 

has a physical interpretation [22] as the average 'energy' density of the flame front. 
This analogy to the mean kinetic energy density for the Navier- Stokes motivates what 
follows. 

The energy (3.6) is intrinsic to the flow, independent of the particular ODE basis 
set chosen to represent the PDE. However, as the Fourier amplitudes are eigenvectors 
of the translation operator, in the Fourier space the energy is a diagonalized quadratic 
norm, 

oo 

E= Ek = ^\akW (3.7) 



GEOMETRY OF THE KURAMOTO-SIVASHINSKY FLOW 



11 



and explicitly invariant term by term under translations (2.6) and reflections (2.5). 

Take time derivative of the energy density (3.6), substitute (2.1) and integrate by 
parts. Total derivatives vanish by the spatial periodicity on the L domain: 

E= (utu) = - {{u'^ /2 ^ Ux ^ Uxxx) ^u) 

= 12 -^ul^Ux Uxxx) ' (3.8) 

The first term in (3.8) vanishes by integration by parts, 3 {ux u^) = {{u^)x) = , and 
integrating the third term by parts yet again one gets [ ] that the energy variation 

E = P-D, P = {ul), D = {ul,) (3.9) 

balances the power P pumped in by anti-diffusion Uxx against the energy dissipation 
rate D by hyper- viscosity Uxxxx in the KS equation (2.1). 

The time averaged energy density E computed on a typical orbit goes to a con- 
stant, so the mean values (3.2) of drive and dissipation exactly balance each other: 

- I f' ■ - - 

E= \im - drE = P-D = 0. (3.10) 

t^OO t Jq 

In particular, the equilibria and relative equilibria fall onto the diagonal in Fig- 
ure 8.1 (a), and so do time averages computed on periodic orbits and relative periodic 
orbits: 

Ep = ^ r dr E{t) , Pp = ^ r dT P{t) = Dp . (3.11) 
-i-p Jo -Lp Jo 

In the Fourier basis (3.7) the conservation of energy on average takes form 

CO 

0= J2 (<ll-<lt)Ek, Ek{t) = l\ak{t)\\ (3.12) 

/c= — CO 

The large k convergence of this series is insensitive to the system size L; Ek have 
to decrease much faster than q^^ . Deviation of Ek from this bound for small k 
determines the active modes. For equilibria an L-independent bound on E is given 
by Michelson [!'^*]. The best current bound [17, 3] on the long-time limit of ^ as a 
function of the system size L scales as E (x L^. 

4. Geometry of state space with L = 22. We now turn to exploring Hopf's 
vision numerically, on a specific KS system. An instructive example is offered by the 
dynamics for the L = 22 system that we specialize to for the rest of this paper. The 
size of this small system is ~ 2.5 mean wavelengths {L/V2 = 2.4758...), and the 
competition between states with wavenumbers 2 and 3 leads to what, in the context 
of boundary shear flows, would be called [23] the 'empirically observed sustained tur- 
bulence,' but in the present context may equally well be characterized as a 'chaotic 
attractor.' A typical long orbit is shown in Figure 4.1. Asymptotic attractor struc- 
ture of small systems like the one studied here is very sensitive to system parameter 
variations, and, as is true of any realistic unsteady flow, there is no rigorous way of 
establishing that this 'turbulence' is sustained for all time, rather than being merely 
a very long transient on a way to an attracting periodic state. For large system size, 
as the one shown in Figure 2.1, it is hard to imagine a scenario under which at- 
tracting periodic states (as shown in ref. [ ], they do exist) would have significantly 
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large immediate basins of attraction. Regardless of the (non)existence of a t ^ oo 
chaotic attractor, study of the invariant unstable solutions and the associated Smale 
horseshoe structures in system's state space offers valuable insights into the observed 
unstable 'coherent structures.' 

Because of the strong contraction, for a small system size the long-time dy- 
namics is confined to low-dimensional inertial manifold [ ]. Indeed, numerically 
the covariant Lyapunov vectors [20] of the L = 22 chaotic attractor separate into 
8 "physical" vectors with small Lyapunov exponents (Xj) = (0.048, 0, 0, —0.003, 
-0.189, -0.256, -0.290, -0.310), and the remaining 54 "hyperbolically isolated" 
vectors with rapidly decreasing exponents {Xj) = (—1.963, —1.967, —5.605, —5.605, 
— 11.923, —11.923, ■ ■ ■) ^ —{j/L)^^ in full agreement with the Yang et al. [49] investi- 
gations of KS for large systems sizes. The chaotic dynamics mostly takes place close to 
a 8-dimensional manifold, with strong contraction in other dimensions. The two zero 
exponents are due to the time and space translational symmetries of the Kuramoto- 
Sivashinsky equation and the 2 corresponding dimensions can be quotiented out by 
means of discrete-time Poincare sections and 0(2) group orbit slices. It was shown in 
refs. [6, 3^] that within unstable-manifold curvilinear coordinate frames, the dynam- 
ics on the attractor can sometimes be well approximated by local 1- or 2-dimensional 
Poincare return maps. Hence a relatively small number of real Fourier modes, such 
as 62 to 126 used in calculations presented here, suffices to obtain invariant solutions 
numerically accurate to within 10~^. 

We next investigate the properties of equilibria and relative equilibria and deter- 
mine numerically a large set of the short periods relative periodic orbits for KS in a 
periodic cell of size L = 22. 

5. Equilibria and relative equilibria for L = 22. In addition to the trivial 
equilibrium u = {) (denoted Eq), we find three equilibria with dominant wavenumber 
k (denoted E^) for k = 1, 2, 3. All equilibria, shown in Figure 5.1, are symmetric with 
respect to the reflection symmetry (2.5). In addition, E2 and E3 are symmetric with 
respect to translation (2.12), by L/2 and L/3, respectively. E2 and E3 essentially lie 
in the 2"^ and 3^^ Fourier component complex planes, with small deformations of the 
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Fig. 5.1. (a) Ki, (b) and (c) Fjs equilibria. The Eq equilibrium is the u(x) = solution, 
(d) {u,Ux,Uxx) representation of (red) Ei, (green) E2, (blue) E3 equilibria, (purple) TW+i, and 
(orange) TW_i relative equilibria. L = 22 system size. 

k = 2j and k = 3j harmonics, respectively. 

The stabihty of the equihbria is characterized by the eigenvalues Xj of the stability 
matrix. The leading 10 eigenvalues for each equilibrium are listed in Table 5.1; those 
with fi > —2.5 are also plotted in Figure 5.2. We have computed (available upon 
request) the corresponding eigenvectors as well. As an equilibrium with ReAj > 
is unstable in the direction of the corresponding eigenvector e^-^\ the eigenvectors 
provide flow-intrinsic (PDE discretization independent) coordinates which we use for 
visualization of unstable manifolds and homo/heteroclinic connections between equi- 
libria. We find such coordinate frames, introduced by Gibson et al. [19, 18], better 
suited to visualization of nontrivial solutions than the more standard Fourier mode 
(eigenvectors of the u{x^ t) = solution) projections. 

The eigenvalues of Eq are determined by the linear part of the KS equation (B.4): 
A/c = (k/L)'^ — (k/L)^. For L = 22, there are three pairs of unstable eigenvalues, 
corresponding, in decreasing order, to three unstable modes /c = 2, 3, and 1. For each 
mode, the corresponding eigenvectors lie in the plane spanned by Re ak and Im a^. 
Table 5.1 lists the symmetries of the stability eigenvectors of equilibria Ei to E3. 

Consistent with the bifurcation diagram of Figure 2.2, we find two pairs of relative 
equilibria (2.15) with velocities c = ±0.73699 and ±0.34954 which we label TW±i 
and TW±2, for 'traveling waves.' The profiles of the two relative equilibria and their 
time evolution with eventual decay into the chaotic attractor are shown in Figure 5.3. 
The leading eigenvalues of TW±i and TW±2 are listed in Table 5.1. 

Table 5.2 lists equilibrium energy the local Poincare section return time T, 
radially expanding Floquet multiplier Ag, and the least contracting Floquet multiplier 
Ac for all L = 22 equilibria and relative equilibria. The return time T = 27r/ue is given 
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Fig. 5.2. Leading equilibrium stability eigenvalues, L = 22 system size. 



by the imaginary part of the leading complex eigenvalue, the expansion multiplier per 
one turn of the most unstable spiral-out by Ae ~ exp(/ie^)7 and the contraction rate 
along the slowest contracting stable eigendirection by Ac ~ exp(/ic^)- For E3 and 
TW±2, whose leading eigenvalues are real, we use T = 1/Ai as the characteristic time 
scale. While the complex eigenvalues set time scales of recurrences, this time scale is 
useful for comparison of leading expanding and the slowest contracting multiplier. We 
learn that the shortest 'turn-over' time is ~ 10 — 20, and that if there exist horseshoe 
sets of unstable periodic orbits associated with these equilibria, they have unstable 
multipliers of order of Ag ~ 5 — 10, and that they are surprisingly thin in the folding 
direction, with contracting multipliers of order of 10~^, as also observed in ref. [38]. 



5.1. Unstable manifolds of equilibria and their heteroclinic connec- 
tions. As shown in Table 5.1, the Ei equilibrium has two unstable planes within 
which the solutions are spiralling out (that is, two pairs of complex conjugate eigen- 
values). The E2 has one such plane, while the E3 has two real positive eigenvalues, so 
the solutions are moving radially away from the equilibrium within the plane spanned 
by the corresponding eigenvectors. Since Ei has a larger unstable subspace, it is ex- 
pected to have much less influence on the long time dynamics compared to E2 and 
E3. 

Many methods have been developed for visualization of stable and unstable mani- 
folds, see ref. [33] for a survey. For high-dimensional contracting flows visualization of 
stable manifolds is impossible, unless the system can be restricted to an approximate 
low-dimensional inertial manifold, as, for example, in ref. [28]. The unstable manifold 
visualization also becomes harder as its dimension increases. Here we concentrate on 
visualizations of 1- and 2-dimensional unstable manifolds. Our visualization is unso- 
phisticated compared to the methods of ref. [ ], yet sufficient for our purposes since, 
as we shall see, the unstable manifolds we study terminate in another equilibrium and 
thus there is no need to track them for long times. 

To construct an invariant manifold containing solutions corresponding to the pair 
of unstable complex conjugate eigenvalues, A = /i ± ii^, /i > 0, we start with a set of 
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Table 5.1 

Leading eigenvalues Xj = jij ± iuj and symmetries of the corresponding eigenvectors of KS 
equilibria and relative equilibria for L = 22 system size. We have used as our reference states 
the ones that lie within the antisymmetric subspace U+, and also listed the symmetries of the L/4 
translated ones. 
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initial conditions near equilibrium E/c, 

a(0) = aE, + e exp((5)e(^') , (5.1) 

where S takes a set of values uniformly distributed in the interval [0, 27r/i/i/], e*^-^^ is a 
unit vector in the unstable plane, and e > is small. 

The manifold starting within the first unstable plane of Ei, with eigenvalues 
0.1308 ± z 0.3341, is shown in Figure 5.4. It appears to fall directly into the chaotic 
attractor. The behavior of the manifold starting within the second unstable plane of 
El, eigenvalues 0.0824 ±z 0.3402, is remarkably different: as can be seen in Figure 5.5, 
almost all orbits within the manifold converge to the equilibrium E2. The manifold 
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Fig. 5.3. Relative equilibria: TW+i with velocity c = 0.737 and TW+2 with velocity c = 0.350. 
The upper panels show the relative equilibria profiles. The lower panels show evolution of slightly 
perturbed relative equilibria and their decay into generic turbulence. Each relative equilibrium has a 
reflection symmetric partner related by u{x) —u(—x) travelling with velocity —c. 



aeir vicm- 



Table 5.2 

Properties of equilibria and relative equilibria determining the system dynamics in the.. 
ity. T is characteristic time scale of the dynamics, Ae and Ac are the leading expansion and 
contraction multipliers, and E is the energy (3.6). 
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also contains a heteroclinic connection from Ei to E3, and is bordered by the Ai- 
eigendirection unstable manifold of E3. 

The two-dimensional unstable manifold of E2 is shown in Figure 5.6. All orbits 
within the manifold, except for the heteroclinic connections from E2 to E3, converge 
to E2 shifted by so this manifold, minus the heteroclinic connections, can be 

viewed as a homoclinic connection. 

The equilibrium E3 has a pair of real unstable eigenvalues equal to each other. 
Therefore, within the plane spanned by the corresponding eigenvectors, the orbits 
move radially away from the equilibrium. In order to trace out the unstable manifold. 
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Orbit A Orbit B 




Fig. 5.4. The left panel shows the unstable manifold of equilibrium Ei starting within the 
plane corresponding to the first pair of unstable eigenvalues. The coordinate axes vi, V2, and are 
projections onto three orthonormal vectors vi, V2; and V3, respectively, constructed from vectors 
Re e(^), Ime(^), and Re e(^) by Gram-Schmidt orthogonalization. The right panel shows spatial 
representation of two orbits A and B. The change of color from blue to red indicates increasing 
values ofu{x), as in the colorbar of Figure 2.1. 




Fig. 5.5. The left panel shows the unstable manifold of equilibrium Ei starting within the plane 
corresponding to the second pair of unstable eigenvalues. The coordinate axes vi, V2, and v^, are 
projections onto three orthonormal vectors wi, V2, and V3^ respectively, constructed from vectors 
Re e('^\ Im e^^^, and Re e^^^ by Gram-Schmidt orthogonalization. The right panel shows spatial 
representation of three orbits. Orbits B and C pass close to the equilibrium E3 . 

we start with a set of initial conditions within the unstable plane 

a(0) = ttEa + e(vi cos(/) + V2 sin(/)) , G [0, 27r] , (5.2) 

where vi and V2 are orthonormal vectors within the plane spanned by the two un- 
stable eigenvectors. The unstable manifold of E3 is shown in Figure 5.8. The 3-fold 
symmetry of the manifold is related to the symmetry of E3 with respect to translation 
by L/3. The manifold contains heteroclinic orbits connecting E3 to three different 
points of the circle of equilibria E2 translated set of solutions. Note also that the 
segments of orbits B and C between E3 and E2 in Figures 5.5 and 5.6 represent the 
same heteroclinic connections as orbits B and C in Figure 5.8. 

Heteroclinic connections are non-generic for high-dimensional systems, but can be 
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Fig. 5.6. The left panel shows the two-dimensional unstable manifold of equilibrium E2. The 
coordinate axes vi, V2, and are projections onto three orthonormal vectors vi, V2, and w^, 
respectively, constructed from vectors Re Im and Re e^^^ by Gram-Schmidt orthogo- 

nalization. The right panel shows spatial representation of three orbits. Orbits B and C pass close 
to the equilibrium E3 . See Figure 5. 7 for a different visualization. 




[a) 

Fig. 5.7. (a) (blue/green) The unstable manifold 0/E2 equilibrium, projection in the coordinate 
axes of Figure 5.6. (black line) The circle of E2 equilibria related by the translation invariance. 
(purple line) The circle of equilibria, (red) The heteroclinic connection from the E2 equilibrium 
to the E3 equilibrium splits the manifold into two parts, colored (blue) and (green), (b) E2 equilibrium 
to E3 equilibrium heteroclinic connection, (Re e^^^, Re e^^^, (Im e^'^^+Im e(^))/\/2) projection. Here 
we omit the unstable manifold 0/E2, keeping only a few neighboring trajectories in order to indicate 
the unstable manifold of E3. The E2 and E3 families of equilibria arising from the continuous 
translational symmetry of KS on a periodic domain are indicated by the two circles. 



robust in systems with continuous symmetry, see ref. [35] for a review. Armbruster et 
al. [ ] study a fourth order truncation of KS dynamics on the center-unstable manifold 
of E2 close to a bifurcation off the constant t) = solution and prove existence of 
a heteroclinic connection, see also ref. [ ]. Kevrekidis et al. [ ] study the dynamics 
numerically and establish the existence of a robust heteroclinic connection for a range 
of parameters close to the onset of the 2-cell branch in terms of the symmetry and 
a flow invariant subspace. We adopt their arguments to explain the new heteroclinic 
connections shown in Figure 5.9 that we have found for L = 22. For our system size 
there are exactly two representatives of the E2 family that lie in the intersection of 
U+ and U^^^ related to each other by an L/4 shift. Denote them by E2 and ri/4E2 
respectively. The unstable eigenplane of E2 lies on U+ while that of T114E2 lies on 
cf. Table 5.1. The E3 family members that live in U+ have one of their unstable 
eigenvectors (the one related to the heteroclinic connection to E2 family) on U+, 
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Fig. 5.8. The left panel shows the two-dimensional unstable manifold of equilibrium E3. The 
coordinate axes vi, V2, and v^, are projections onto three orthonormal vectors vi, W2, and w^,, 
respectively, constructed from vectors e^^\ e(^\ and g^"^^ by Gram-Schmidt orthogonalization. The 
black line shows a family of E2 equilibria related by translational symmetry. The right panel shows 
spatial representation of three orbits. Orbits B and C are two different heteroclinic orbits connecting 
E3 to the same point on the E2 line. 



E2 




Fig. 5.9. Heteroclinic connections on U+; (red) The unstable manifold of Ki equilibrium, 
(blue/green) The unstable manifold of Fj2 equilibrium, (black) Heteroclinic connections from Fjs equi- 
librium to ri/4E2 equilibrium, where ri/^u(x) = u(x -\- L/m) is a rational shift (2.6). Projection 
from 128 dimensions onto the plane given by the vectors a^^ — a^-^^^-E^ ^'^^ a^^ — a^-^^^^^. 



while the other does not he on symmetry-invariant subspace. Similarly, for the Ei 
family we observe that the equilibria in have an unstable plane on (again 
related to the heteroclinic connection) and a second one with no symmetry. Thus 
T114E2 appears as a sink on U+, while all other equilibria appear as sources. This 
explains the heteroclinic connections from Ei , E2 and E3 to ri/4E2. Observing that 
ri/4U+ = U^^^ and taking into account Table 5.1 we understand that within U^^^ we 
have connections from T114E2 (and members of Ei and E3 families) to E2 and the 
formation of a heteroclinic loop. Due to the translational invariance of KS there is a 
heteroclinic loop for any two points of the E2 family related by an ri/4-shift. 
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Fig. 6.1. Selected relative periodic and pre-periodic orbits of KS flow with L = 22: (a) Tp = 
16.3, ip = 2.86; (h) Tp = 32.8, ip = 10.96; (c) Tp = 33.5, ip = 4.04; (d) Tp = 34.6, ip = 9.60; 
(e) Tp = 47.6, ip = 5.68; (f) Tp = 59.9, ip = 5.44; (g) Tp = 71.7, ip = 5.503; (h) Tp = 84.4, 
ip = 5.513; (i) Tp = 10.3; (j) Tp = 32.4; (k) Tp = 33.4; (I) Tp = 35.2. Horizontal and vertical white 
lines indicate periodicity and phase shift of the orbits, respectively. 



6. Relative periodic orbits for L = 22. The relative periodic orbits satisfy 
the condition (2.20) u{x + ip^Tp) = ^i(x,0), where Tp is the period and £p the phase 
shift. We have limited our search to orbits with Tp < 200 and found over 30000 
relative periodic orbits with £p > 0. The details of the algorithm used and the search 
strategy employed are given in appendix C. Each relative periodic orbit with phase 
shift £p > has a reflection symmetric partner Up{x) —Up{—x) with phase shift 

The small period relative periodic orbits outline the coarse structure of the chaotic 
attractor, while the longer period relative periodic orbits resolve the finer details of 
the dynamics. The first four orbits with the shortest periods we have found are shown 
in Figure 6.1 (a-d). The shortest relative periodic orbit with Tp = 16.4 is also the most 
unstable, with one positive Floquet exponent equal 0.328. The other short orbits are 
less unstable, with the largest Floquet exponent in the range 0.018 - 0.073, typical of 
the long time attractor average. 

We have found relative periodic orbits which stay close to the unstable manifold 
of E2. As is illustrated in Figure 6.1(e-/i), all such orbits have shift ip ~ L/A^ 
similar to the shift of orbits within the unstable manifold of E2, which start at E2 



GEOMETRY OF THE KURAMOTO-SIVASHINSKY FLOW 



21 




Fig. 8.1. (a) Power input P vs. dissipation rate D (b) energy E vs. power input P, for 
several equilibria and relative equilibria, a relative periodic orbit, and a typical 'turbulent^ long-time 
trajectory. Projections of the heteroclinic connections are given in Figure 8.2. System size L = 22. 



and converge to T114E2 (see Figure 5.6). This confirms that the 'cage' of unstable 
manifolds of equilibria plays an important role in organizing the chaotic dynamics of 
the KS equation. 

7. Pre-periodic orbits. As discussed in Sect. 2.3, a relative periodic orbit will 
be periodic, that is, £p = 0, if it either (a) lives within the U+ antisymmetric subspace, 
—u{—x^O) = 7x(x,0), or (b) returns to its reflection or its discrete rotation after 
a period: u{x^t + Tp) = ju{x^t)^ 7^ = e, and is thus periodic with period mTp. 
The dynamics of KS flow in the antisymmetric subspace and periodic orbits with 
symmetry (a) have been investigated previously [6, 37, 38]. The KS flow does not 
have any periodic orbits of this type for L = 22. 

Using the algorithm and strategy described in appendix C, we have found over 
30 000 pre-periodic orbits with Tp < 200 which possess the symmetry of type (b) with 
J = R G Di. Some of the shortest such orbits we have found are shown in Figure 6.1 (z- 
/). Several were found as repeats of pre-periodic orbits during searches for relative 
periodic orbits with non-zero shifts, while most have been found as solutions of the 
pre-periodic orbit condition (2.21) with reflection, which takes form 

-g{-i)a*{Tp)=a{0). (7.1) 

in the Fourier space representation (compare this to the condition (C.l) for relative 
periodic orbits). 

8. Energy transfer rates for L = 22. In Figure 8.1 we plot (3.9), the time- 
dependent E in the power input P vs. dissipation rate D plane, for L = 22 equilibria 
and relative equilibria, a selected relative periodic orbit, and for a typical 'turbulent' 
long-time trajectory. 

Projections from the 00-dimensional state space onto the 3-dimensional {E, P, D) 
representation of the flow, such as Figures 8.1 and 8.2, can be misleading. The most 
one can say is that if points are clearly separated in an {E, P, D) plot (for example, 
in Figure 8.1 Ei equilibrium is outside the recurrent set), they are also separated in 
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Fig. 8.2. Two projections of the {E,P,E) representation of the flow. Ei (red), E2 (green), 
E3 (blue), heteroclinic connections from E2 to E3 (green), from Ei to E3 (red) and from E3 to 
E2 (shades of blue), superimposed over a generic long-time 'turbulent^ trajectory (grey), (a) As in 
Figure 8.2(b), with labels omitted for clarity, (b) A plot of E = P — D yields a clearer visualization 
than Figure 8.2 (a). System size L = 22. 

the full state space. Converse is not true - states of very different topology can have 
similar energies. 

An example is the relative periodic orbit (Tp, Ip) = (32.8, 10.96) (see Figure 6.1(b)) 
which is the least unstable short relative periodic orbit we have detected in this sys- 
tem. It appears to be well embedded within the turbulent flow. The mean power Pp 
evaluated as in (3.11), see Figure 8.1, is numerically quite close to the long-time tur- 
bulent time average P. Similarly close prediction of mean dissipation rate in the plane 
Couette flow from a single-period periodic orbit computed by Kawahara and Kida [; ] 
has lead to optimistic hopes that 'turbulence' is different from low-dimensional chaos, 
insofar that the determination of one special periodic orbit could yield all long-time 
averages. Regrettably, not true - as always, here too one needs a hierarchy of periodic 
orbits of increasing length to obtain accurate predictions [ ]. 

For any given relative periodic orbit a convenient visualization is offered by the 
mean velocity frame^ that is, a reference frame that rotates with velocity Cp = ip/Tp. 
In the mean velocity frame a relative periodic orbit becomes a periodic orbit, as in 
Figure 8.3 (6). However, each relative periodic orbit has its own mean velocity frame 
and thus sets of relative periodic orbits are difficult to visualize simultaneously. 

9. Summary. In this paper we study the Kuramoto-Sivashinsky flow as a stas~ 
ing ground for testing dynamical systems approaches to moderate Reynolds number 
turbulence in full-fledged {not a few- modes model), infinite-dimensional state space 
PDF settings [25], and present a detailed geometrical portrait of dynamics in the 
Kuramoto-Sivashinsky state space for the L = 22 system size, the smallest system 
size for which this system empirically exhibits 'sustained turbulence.' 

Compared to the earlier work [6, 37, 38, 40], the main advances here are the new 
insights in the role that continuous symmetries, discrete symmetries, low-dimensional 
unstable manifolds of equilibria, and the connections between equilibria play in orga- 
nizing the flow. The key new feature of the translationally invariant KS on a periodic 
domain are the attendant continuous families of relative equilibria (traveling waves) 
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Fig. 8.3. The relative periodic orbit with {Tp,ip) = (33.5,4.04) from Figure 6.1(c) which 
appears well embedded within the turbulent flow: (a) A stationary state space projection, traced for 
four periods Tp. The coordinate axes vi, V2, and V2, are those of Figure 5.6; (b) In the co-moving 
mean velocity frame. 

and relative periodic orbits. We have now understood the preponderance of solutions 
of relative type, and lost fear of them: a large number of unstable relative periodic 
orbits and periodic orbits has been determined here numerically. 

Visualization of infinite-dimensional state space flows, especially in presence of 
continuous symmetries, is not straightforward. At first glance, turbulent dynamics 
visualized in the state space appears hopelessly complex, but under a detailed exami- 
nation it is much less so than feared: for strongly dissipative flows (KS, Navier- Stokes) 
it is pieced together from low dimensional local unstable manifolds connected by fast 
transient interludes. In this paper we offer two low-dimensional visualizations of such 
flows: (1) projections onto 2- or 3-dimensional, PDE representation independent dy- 
namically invariant frames, and (2) projections onto the physical, symmetry invariant 
but time-dependent energy transfer rates. 

Relative periodic orbits require a reformulation of the periodic orbit theory [10], 
as well as a rethinking of the dynamical systems approaches to constructing symbolic 
dynamics, outstanding problems that we hope to address in near future [45, 44]. What 
we have learned from the L = 22 system is that many of these relative periodic orbits 
appear organized by the unstable manifold of E2, closely following the homoclinic 
loop formed between E2 and T114E2. 

In the spirit of the parallel studies of boundary shear flows [ ], the Kuramoto- 
Sivashinsky L = 22 system size was chosen as the smallest system size for which KS 
empirically exhibits 'sustained turbulence.' This is convenient both for the analysis of 
the state space geometry, and for the numerical reasons, but the price is high - much 
of the observed dynamics is specific to this unphysical, externally imposed periodicity. 
What needs to be understood is the nature of equilibrium and relative periodic orbit 
solutions in the L ^ 00 limit, and the structure of the L = 00 periodic orbit theory. 

In summary, Kuramoto-Sivashinsky (and plane Couette flow, see ref. [19]) equi- 
libria, relative equilibria, periodic orbits and relative periodic orbits embody Hopf's 
vision [26]: together they form the repertoire of recurrent spatio-temporal patterns 
explored by turbulent dynamics. 
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Appendix A. Integrating Kuramoto-Sivashinsky equation numerically. 

The Kuramoto-Sivashinsky equation in terms of Fourier modes: 

Uk = :F[u]k = ^ [ u{x, t)e-''^^''dx , u{x, t) = T'^ \u\ = ^ Ukc'''''' (A.l) 
is given by 

i^k = {ql - qt) Uk - '-f:F[{J^-'[u]f]k ■ (A.2) 

Since u is real, the Fourier modes are related by U-k = u^.. 

The above system is truncated as follows: The Fourier transform is replaced 
by its discrete equivalent 

N-l N-1 

ak = J^N^k = <xn)e-'^'''- , u{xn) = :F^Mn = ^ Yl ^kc'^'"'' , (A.3) 

n=0 k=0 

where Xn = nL/N and aN-k = clI- Since ao = due to Galilean invariance and 
setting a7v/2 = (assuming N is even), the number of independent variables in the 
truncated system is — 2: 

dk = Vk{a) = {ql - qt) - ^.^iv[(.^^M«])']fc , (A.4) 

where = 1, . . . , N/2 — 1, although in the Fourier transform we need to use ak over 
the full range of k values from to A/" — 1. As a/e G C, (A.4) represents a system of 
ordinary differential equations in R^~^. 

The discrete Fourier transform J^n can be computed by EFT. In Fortran and C, 
the FFTW library ref. [ ] can be used. 

In order to find the fundamental matrix of the solution, or compute Lyapunov 
exponents of the Kuramoto-Sivashinsky flow, one needs to solve the equation for a 
displacement vector b in the tangent space: 

Since J^n is a linear operator, it is easy to show that 

h = {ql - qt) h - iqk^N[^N^[o] ^^N^[b]]k , (A.6) 



where indicates componentwise product of two vectors, that is, a 6 = diag(a) b = 
diag(6) a. This equation needs to be solved simultaneously with (A.4). 
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Equations (A. 4) and (A. 6) were solved using the exponential time differencing 
4tli-order Runge-Kutta method (ETDRK4) [7, 30]. 

Appendix B. Determining stability properties of equilibria, traveling 
waves, and relative periodic orbits. 

Let be the flow map of the Kuramoto-Sivashinsky equation, that is f^{a) = a{t) 
is the solution of (A. 4) with initial condition a(0) = a. The stability properties of the 
solution f^{a) are determined by the fundamental matrix J{a^t) consisting of partial 
derivatives of f^{a) with respect to a. Since a and are complex valued vectors, 
the real valued matrix J{a^t) contains partial derivatives evaluated separately with 
respect to the real and imaginary parts of a, that is 



J{a,t) = 



dfja) 
da 





9fk,i 


9fk,i 


dan, I 




daR,2 


















dfR,2 




dCLl,l 


daR,2 



\ 



V 



(B.l) 



where Uk = ank ■ 



-iai,k and/* = /*j fe- 



/ 



The partial derivatives 



_d£_ 



and 



are determined by solving (A. 6) with initial conditions 6/e(0) = hN-k{^) = 1 + Oz and 
6/c(0) = — 6Ar-/c(0) = + Iz, respectively, for k = j and hk(jS) = otherwise. 

The stability of a periodic orbit with period Tp is determined by the location of 
eivenvalues of J{ap^Tp) with respect to the unit circle in the complex plane. 

Because of the translation invariance, the stability of a relative periodic orbit is 
determined by the eigenvalues of the matrix g{ip) J{ap^Tp), where g(^) is the action 
of the translation operator introduced in (2.6), which in real valued representation 
takes the form of a block diagonal matrix with the 2x2 blocks 



— sin qi^i cos q^i 



k = l,2,...,7V/2-l, 



For an equilibrium solution a^, f^{aq) = aq and so the fundamental matrix J(ag, t) 
can be expressed in terms of the time independent stability matrix A{aq) as follows 

where 



A{aq) 



dv 
da 



(B.2) 



Using the real valued representation of (B.l), the partial derivatives of v{a) with 
respect to the real and imaginary parts of a are given by 



dvk 
danj 
dvk 



da 



{qI - Qk) ^hj - iqk^N[^N^[a\ ^N^[b\^^]]k , 



(B.3) 



where and are complex valued vectors such that b^^\ = ^^^7v-/e 



^i,k 



^I,N-k — 



+ n for A: = j and b^i\ = b\^l = 



1 -\- Oi and 
otherwise. In terms of aR^k 
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and aj^k we have 



dVR,k 
dVR,k 

daij 
dvi,k 

dvi,k 
da I J 



{qI - Qk) ^kj + qk{ai^k+j + CLi,k-j) 



{qI - Qk) ^kj - qk{ai,k+j - di.k-j) , 



Qk{ctR,k+j - CtR,k-j) , 



Qk{ciR,k-\-j + CLR,k-j) , 



(B.4) 



where Skj is Kronecker delta. 

The stabihty of equihbria is characterized by the sign of the real part of the 
eigenvalues of A{aq). The stability of a relative equilibrium is detemined in the co- 
moving reference frame, so the fundamental matrix takes the form g{cqt) J{aq^ t). The 
stability matrix of a relative equilibrium is thus equal to A{aq)^CqC where C = iqk^kj 
is the Lie algebra translation generator, which in the real-space representation takes 
the form C = diag(0, gi, 0, ^2, • • •)• 

Appendix C. Levenberg— Marquardt searches for relative periodic or- 
bits. 

To find relative periodic orbits of the Kuramoto-Sivashinsky fiow, we use multiple 
shooting and the Levenberg-Marquardt (LM) algorithm implemented in the routine 
Imder from the MINPACK software package [43]. 

In order to find periodic orbits, a system of nonlinear algebraic equations needs to 
be solved. For fiows, this system is underdetermined, so, traditionally, it is augmented 
with a constraint that restricts the search space to be transversal to the fiow (oth- 
erwise, most of the popular solvers of systems of nonlinear algebraic equations, e.g. 
those based on Newton's method, cannot be used). When detecting relative periodic 
orbits, a constraint is added for each continuous symmetry of the fiow. For example, 
when detecting relative periodic orbits in the complex Ginzburg Landau equation, 
Lopez et al. [ ] introduce three additional constraints. 

Our approach differs from those used previously in that we do not introduce the 
constraints. Being an optimization solver, the LM algorithm has no problem with 
solving an underdetermined system of equations, and, even though Imder explicitly 
restricts the number of equations to be not smaller than the number of variables, the 
additional equations can be set identically equal to zero [ ]. In fact, there is numerical 
evidence that, when implemented with additional constraints, the solver usually takes 
more steps to converge from the same seed, or fails to converge at all [8]. In what 
follows we give a detailed description of the algorithm and the search strategy which 
we have used to find a large number of relative periodic orbits defined in (2.20) and 
pre-periodic orbits defined in (2.21). 

When searching for relative periodic orbits of truncated Kuramoto-Sivashinsky 
equation (A. 4), we need to solve the system of A" — 2 equations 



with N unknowns (a^T^i)^ where is the fiow map of the Kuramoto-Sivashinsky 
equation. In the case of pre-periodic orbits, the system has the form 



g{e)f{a)-a = 0, 



(C.l) 



-g{-e)[f{a)]*-a = 0, 



(C.2) 
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(see (7.1)). 

We have tried two different implementations of the multiple shooting. The em- 
phasis was on the simplicity of the implementations, so, even though both implemen- 
tations worked equally well, each of them had its own minor drawbacks. 

In the first implementation, we fix the total number of steps within each shooting 
stage and change the numerical integrator step size h in order to adjust the total 
integration time to a desired value T. 

Let (a, T, i) be the starting guess for a relative periodic orbit obtained through 
a close return within a chaotic attractor (see below). We require that the initial 
integration step size does not exceed ho^ so we round off the number of integration 
steps to n = where [x] denotes the nearest integer larger than x. 

The integration step size is equal to h = T/n. With the number of shooting stages 
equal to m, the system in (C.l) is rewritten as follows 

FW=r(a«)-a(2) =0, 
F(2) = /-(a(2))-a(3) =0, 

(C.3) 

where t = [n/m\h {[x\ is the nearest integer smaller than x), t' = nh — (m — 1)t, 
and a'-') = /^-'""'"•'^(a), j = 1, . . . , m. For the detection of pre-periodic orbits, the last 
equation in (C.3) should be replaced with 

= -g(-^)[r'(a^™))]* - a^^) = . 
With the fundamental matrix of (C.3) written as 

J = — — , j,k = 1, . . . ,m , (C.4) 

the partial derivatives with respect to a^''^ can be calculated using the solution of 
(A. 6) as described in appendix B. The partial derivatives with respect to T are given 
by 



9pU^^( dr^^ ^^^^r(^^U)))in/m\/n, j = l,...,m-l 
\ g(£)t;(/-'(aO)))(l-H^Ln/mJ), j = m. 



(C.5) 



Note that, even though df*{a)/dt = v{f*{a))^ it should not be evaluated using the 
equation for the vector field v. The reason is that, since the flow is approximated 
by a numerical solution, the derivative of the numerical solution with respect to the 
step size h may differ from the vector field especially for larger step sizes. We 
evaluate the derivative by a forward difference using numerical integration with step 
sizes h and h-\- 6: 



dt ~JS 



/^■(^+^)(a)-/^-^(a)l , (C.6) 



with t = jh and S = 10 ^ for double precision calculations. Partial derivatives 
dF^^^ /dl are all equal to zero except for j = where it is given by 

~dr = W^"^^^'^ = diag(%e*'^^)r'(a(™)) . (C.7) 
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Fig. C.l. Numbers of detected relative periodic orbits (RPOs) and pre-periodic orbits (PPOs) 
with periods smaller than T. The lines indicate the linear fit to the logarithm of the number of orbits 
as functions of T in the range T G [70, 120]. 



This fundamental matrix is supplied to Imder augmented with two rows of zeros 
corresponding to the two identical zeros augmenting (C.3) in order to make the number 
of equations formally equal to the number of variables, as discussed above. 

In the second implementation, we keep h and r fixed and vary only t' = T— {m — 
l)r. In this case, we need to be able to determine the numerical solution of Kuramoto- 
Sivashinsky equation not only at times tj = jh^j = 1, 2, . . ., but at any intermediate 
time as well. We do this by a cubic polynomial interpolation through points /^^ (a) 
and /^^+^(a) with slopes v{f*^{a)) and v{f*^+^ {a)). The difference from the first 
implementation is that partial derivatives dF^^^ /dT are zero for all j = 1, . . . , m — 1, 
except for 

Tp{rn) 

^^ = gWKr(«^'"^))- (C.8) 

which, for consistency, needs to be evaluated from the cubic polynomial, not from the 
flow equation evaluated at (a*^^^). 

For detecting relative periodic orbits of the Kuramoto-Sivashinsky flow with L = 
22, we used N = 32, h = 0.25 (or = 0.25 within the first implementation), and 
a number of shooting stages such that r ~ 40.0. While both implementations were 
equally successful in detecting periodic orbits of Kuramoto-Sivashinsky flow, we found 
the second implementation more convenient. 

The following search strategy was adopted: The search for relative periodic orbits 
with T e [10, 200] was conducted within a rectangular region containing the chaotic 
attractor. To generate a seed, a random point was selected within the region and the 
flow (A. 4) was integrated for a transient time t = 40, sufficient for an orbit to settle 
on the attractor at some point d. This point was taken to be the seed location. In 
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order to find orbits witti different periods, ttie time interval [10, 200] was subdivided 
into windows of length 10, i.e. [tmin, ^max], where t^in = lOj and t^ax = 10(j + 1), 
with j = 1,2,..., 19. To determine the seed time T and shift we located an 
approximate global minimum of \\g{£)f^{a) — a\\ (or of || — g(— — «|| in the 
case of pre-periodic orbits) as a function of t G [tmin,^max] and £ G (— L/2,L/2]. We 
did this simply by finding the minimum value of the function on a grid of points with 
resolution h in time and L/50 in i. 

Approximately equal numbers of seeds were generated for the detection of relative 
periodic orbits and pre-periodic orbits and within each time window. The hit rate, 
i.e. the fraction of seeds that converged to relative periodic orbits or pre-periodic 
orbits, varied from about 70% for windows with t^ax ^ 80 to about 30% for windows 
with tmin ^ 160. The total number of hits for relative periodic orbits and pre-periodic 
orbits was over 10^ each. Each newly found orbit was compared, after factoring out 
the translation and reflection symmetries, to those already detected. As the search 
progressed, we found fewer and fewer new orbits, with the numbers first saturating 
for smaller period orbits. At the end of the search we could find very few new orbits 
with periods T < 120. Thus we found over 30 000 distinct prime relative periodic 
orbits with ^ > and over 30000 distinct prime pre-periodic orbits with T < 200. 

In Figure C.l we show the numbers of detected relative periodic orbits and pre- 
periodic orbits with periods less than T. It shows that the numbers of relative periodic 
orbits and pre-periodic orbits are approx. equal and that they grow exponentially with 
increasing T up to T ~ 130, so that we are mostly missing orbits with T > 130. The 
straight line fits to the logarithm of the numbers of orbits in the interval T G [70, 120], 
represented by the lines in Figure C.l, indicate that the total numbers of relative 
periodic orbits and pre-periodic orbits with T < 200 could be over 10^ each. 

To test the structural stability of the detected orbits and their relevance to the 
full Kuramoto-Sivashinsky PDF, the numerical accuracy was improved by increasing 
the number of Fourier modes (A^ = 64) and reducing the step size {h = 0.1). Only a 
handful of orbits failed this higher-resolution test. These orbits were not included in 
the list of the 60,000+ orbits detected. 
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